System and method for interpreting interpersonal communication

ABSTRACT

A method for interpreting interpersonal communication includes monitoring a first interaction between two or more individuals using a set of monitoring devices including a camera, a microphone, and the like. A culture and personality type of at least one individual is identified based on the monitored first interaction. First cultural/personality profile information specific to the identified culture and personality type is retrieved from a database of cultural/personality profile information. A second interaction between the two or more individuals is monitored using the set of monitoring devices. A first facial expression, gesture, vocal intonation, or indication of emotional state derived from biometric data of the at least one individual is identified based on the monitored second interaction. The identified first expression is interpreted using the first cultural/personality profile information. The interpretation of the identified first expression is communicated to a user.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority under 35 U.S.C. §120 to U.S.application Ser. No. 14/755,752 filed on Jun. 30, 2015 in the UnitedStates Patent and Trademark Office, the disclosure of which isincorporated by reference herein in its entirety.

TECHNICAL FIELD

Exemplary embodiments of the inventive concept relate to interpretingcommunication, and more particularly, to systems and methods forinterpreting interpersonal communication.

DISCUSSION OF THE RELATED ART

Cross-cultural interactions between participants of different culturesare becoming more frequent in recent times. A first individual mayinteract with a second individual. The second individual may have aculture that is different from the first individual's culture. Thus, thefirst individual may need to acquire information regarding the secondindividual's culture. The first individual may gain informationregarding the culture of the second individual by reading a book thatdescribes the second individual's culture in detail, prior to themeeting.

Reading books to gain cultural information may be a difficult andtime-consuming task. Further, an individual may interact with aplurality of individuals having a plurality of different cultures. Thus,reading a plurality of books to memorize information specific to aplurality of cultures may be a difficult task and an inefficient use oftime.

SUMMARY

According to an exemplary embodiment of the inventive concept, a methodfor interpreting interpersonal communication includes monitoring a firstinteraction between two or more individuals using a set of monitoringdevices including a camera, a video camera, or a microphone. A cultureand personality type of at least one of the two or more individuals isidentified based on the monitored first interaction. Firstcultural/personality profile information specific to the identifiedculture and personality type is retrieved from a database ofcultural/personality profile information. A second interaction betweenthe two or more individuals is monitored using the set of monitoringdevices. A first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data of the atleast one of the two or more individuals is identified based on themonitored second interaction. The identified first facial expression,gesture, vocal intonation, or indication of emotional state derived frombiometric data is interpreted using the first cultural/personalityprofile information. The interpretation of the identified first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data is communicated to a user.

In an exemplary embodiment of the inventive concept, a third interactionbetween the two or more individuals may be monitored using the set ofmonitoring devices including the camera, the video camera, or themicrophone. The identification of the first culture and personality typeof the at least one of the two or more individuals may be updated basedon the monitored third interaction. Second cultural/personality profileinformation specific to the updated identified culture and personalitytype may be retrieved from the database of cultural/personality profileinformation, the second cultural/personality profile information beingdifferent from the first cultural/personality profile information. Afourth interaction between the two or more individuals may be monitoredusing the set of monitoring devices including the camera, the videocamera, or the microphone. A second facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric dataof the at least one of the two or more individuals may be identifiedbased on the monitored fourth interaction. The identified second facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data may be interpreted using the secondcultural/personality profile information. The interpretation of theidentified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data may becommunicated to a user.

In an exemplary embodiment of the inventive concept, the database ofcultural/personality profile information may include a plurality ofcultural/personality profile information specific to various culture andpersonality types.

In an exemplary embodiment of the inventive concept, the plurality ofcultural/personality profile information specific to various culture andpersonality types may be generated based on an examination of trainingdata.

In an exemplary embodiment of the inventive concept, the training datamay include video imagery which has been annotated to indicate a cultureand personality type of various participants and has been annotated toidentify a meaning of one or more facial expressions, gestures, vocalintonations, and indications of emotional state derived from biometricdata.

In an exemplary embodiment of the inventive concept, the user may be oneof the two or more individuals other than the at least one of the two ormore individuals.

In an exemplary embodiment of the inventive concept, the first andsecond interactions may be instantiated by a videoconference and themonitoring of the first and second interactions may include monitoringthe videoconference.

In an exemplary embodiment of the inventive concept, the interpretationof the identified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data to the usermay include superimposing the interpretation of the identified firstfacial expression, gesture, vocal intonation, or indication of emotionalstate derived from biometric data on a videoconference such that it maybe observed by a party to the videoconference other than the at leastone of the two or more individuals.

In an exemplary embodiment of the inventive concept, the interpretationof the identified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data, communicatedto the user, may include advice on how to respond to the identifiedfirst facial expression, gesture, vocal intonation, or indication ofemotional state derived from biometric data.

In an exemplary embodiment of the inventive concept, communicating theinterpretation of the identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric datato the user may include sending the user a text message.

In an exemplary embodiment of the inventive concept, the user and the atleast one of the two or more individuals may be the same person and theinterpretation of the identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometricdata, communicated to the user, may include an indication that theidentified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data is potentiallydetrimental to constructive conversation.

In an exemplary embodiment of the inventive concept, a culture andpersonality type of the two or more individuals who are not the user mayalso be considered in determining whether the identified first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data is potentially detrimental to constructiveconversation.

According to an exemplary embodiment of the inventive concept, a systemfor interpreting interpersonal communication includes a processor and aset of monitoring devices including a camera, a video camera, or amicrophone. A non-transitory, tangible program storage medium, readableby the system for interpreting interpersonal communication, embodying aprogram of instructions executable by the processor, performs methodsteps for interpreting interpersonal communication. The method includesmonitoring a first interaction between two or more individuals using theset of monitoring devices including the camera, the video camera, or themicrophone. A culture and personality type of at least one of the two ormore individuals is identified based on the monitored first interaction.First cultural/personality profile information specific to theidentified culture and personality type is retrieved from a database ofcultural/personality profile information. A second interaction betweenthe two or more individuals is monitored using the set of monitoringdevices including the camera, the video camera, or the microphone. Afirst facial expression, gesture, vocal intonation, or indication ofemotional state derived from biometric data of the at least one of thetwo or more individuals is identified based on the monitored secondinteraction. The identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric datais interpreted using the first cultural/personality profile information.The interpretation of the identified first facial expression, gesture,vocal intonation, or indication of emotional state derived frombiometric data is communicated to a user.

In an exemplary embodiment of the inventive concept, the set ofmonitoring devices may include one or more cameras mounted and pointedtoward the at least one of the two or more individuals. The one or morecameras may be configured to automatically move to maintain focus on theat least one of the two or more individuals.

In an exemplary embodiment of the inventive concept, a wearable computerworn by the user may be included. The wearable computer may receive amessage. The message may include the communication of the interpretationof the identified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data, via a textualmessage, an audible message, or a tactile message.

In an exemplary embodiment of the inventive concept, a handheld mobiledevice may be included. Communicating the interpretation of theidentified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data to the usermay include sending the user a text message that may be displayed on thehandheld mobile device.

According to an exemplary embodiment of the inventive concept, a systemfor video conferencing includes a processor and two or more terminals,each of the two or more terminals including a set of monitoring devicesincluding a camera, a video camera, or a microphone. A non-transitory,tangible program storage medium, readable by the system for interpretinginterpersonal communication, embodying a program of instructionsexecutable by the processor, performs method steps for interpretinginterpersonal communication. The method includes monitoring a firstinteraction between two or more individuals. A first individual of thetwo or more individuals is located at a first terminal of the two ormore terminals. A second individual of the two or more individuals islocated at a second terminal of the two or more terminals. Monitoringthe first interaction between the two or more individuals includes usingthe set of monitoring devices including the camera, the video camera, orthe microphone included in each of the first and second terminals tomonitor the first and second individuals. A culture and personality typeof at least one of the first and second individuals is identified basedon the monitored first interaction. First cultural/personality profileinformation specific to the identified culture and personality type isretrieved from a database of cultural/personality profile information. Asecond interaction between the first and second individuals located atthe first and second terminals is monitored using the set of monitoringdevices including the camera, the video camera, or the microphoneincluded in each of the first and second terminals. A first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data of the at least one of the first and secondindividuals is identified based on the monitored second interaction. Theidentified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data is interpretedusing the first cultural/personality profile information. Theinterpretation of the identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric datais communicated to a user.

In an exemplary embodiment of the inventive concept, the system forvideo conferencing may be a cloud-based system. The cloud-based systemmay include the two or more terminals communicating with the processorover the Internet.

In an exemplary embodiment of the inventive concept, each of the firstand second terminals, among the two or more terminals, may include adisplay device and a camera device. The camera device included in thesecond terminal may be configured to automatically move to maintainfocus on the second individual. The display device included in the firstterminal may be configured to display a camera image captured by thecamera device included in the second terminal.

In an exemplary embodiment of the inventive concept, the user and thefirst individual may be the same person. Communicating theinterpretation of the identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric datato the user may include displaying a textual message on the displaydevice included in the first terminal.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features and aspects of the inventive concept willbecome more apparent by describing in detail exemplary embodimentsthereof with reference to the accompanying drawings, in which:

FIG. 1 illustrates a flow chart of a method for interpretinginterpersonal communication, according to an exemplary embodiment of theinventive concept;

FIG. 2 illustrates a flow chart of a method for interpretinginterpersonal communication, according to an exemplary embodiment of theinventive concept;

FIG. 3 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept;

FIG. 4 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept;

FIG. 5 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept; and

FIG. 6 illustrates an example of a computer system capable ofimplementing the method and apparatus according to embodiments of thepresent disclosure.

DETAILED DESCRIPTION OF THE EMBODIMENTS

The descriptions of the various exemplary embodiments of the presentinvention have been presented for purposes of illustration, but are notintended to be exhaustive or limited to the exemplary embodimentsdisclosed. Many modifications and variations will be apparent to thoseof ordinary skill in the art without departing from the scope and spiritof the described exemplary embodiments. The terminology used herein waschosen to best explain the principles of the exemplary embodiments, orto enable others of ordinary skill in the art to understand exemplaryembodiments described herein.

The flowcharts and/or block diagrams in the figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousexemplary embodiments of the inventive concept. In this regard, eachblock in the flowchart or block diagrams may represent a module,segment, or portion of instructions, which comprises one or moreexecutable instructions for implementing the specified logicalfunction(s). In alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts or carry outcombinations of special purpose hardware and computer instructions.

According to an exemplary embodiment of the inventive concept, a methodfor interpreting interpersonal communication may include gatheringtraining data. The training data may include visual data such as stillimages and video showing humans interacting with each other. Thetraining data may include audible data such as sounds, vocalintonations, and the like, made by humans.

The training data may be annotated by a human expert. The human expertmay identify and annotate the culture type of each individual shown onthe videos by observing the acts and appearance of each individual. Thehuman expert may identify and annotate the audible data or thecombination of the visual and audible data by listening to the audibledata and watching the videos with sound, respectively. The human expertmay identify gestures, vocal intonations, facial expressions, and thelike, that each actor may exhibit, and may annotate the gesture, vocalintonation and/or facial expression on the video, or audio, orcombination of video and audio, as well as the interpretation of thegesture, vocal intonation and/or facial expression. For each culturetype, individuals may be categorized into personality subgroups. Thus,each individual may be sorted into a pair of culture and personalitysubgroup. The expert may annotate the culture and personality type ofeach individual on the training data.

A first set of signature files may be created to determine the culturaland personality subgroup of at least one individual, among two or moreindividuals interacting with each other. The first set of signaturefiles may be created using the annotated training data. For eachcultural and personality subgroup, a second set of signature files maybe created to identify facial expressions, gestures, vocal intonations,and the like, of individuals grouped in the particularculture/personality subgroup. The second set of signature files may becreated using the training data. Alternatively, classifiers may betrained to perform what the signature files may perform.

A table may be developed for each culture/personality subgroup. Thetable may include entries for each culture/personality subgroupidentified by the human expert using the training data. One entry on thetable may correspond to one culture/personality subgroup. Each tableentry may include the second set of signature files for detectingexpressions and the corresponding interpretations of the expressions ofthe individuals classified as having the culture/personality subgroupcorresponding to the entry.

A communication between two or more individuals may be monitored inreal-time. The communication may be monitored with reference to thefirst and second sets of signature files to classify the individualsinto culture/personality subgroups, to identify and interpret theindividuals' expressions using the determined culture/personalitysubgroup for each individual, and to simultaneously reclassify theindividuals into different culture/personality subgroups.

The individuals may receive alerts including the interpretation ofactions that have been identified. Also, users may be alerted whenactions that they are about to take may be offensive to another userthat they are interacting with.

FIG. 1 illustrates a flow chart of a method for interpretinginterpersonal communication, according to an exemplary embodiment of theinventive concept. Referring to FIG. 1, step S100 includes receivingtraining data. The training data may include videos displayingindividuals acting, audio recording of individuals interacting, or videocombined with audio of individuals interacting. A human expert may viewthe videos, hear the audio recordings, or view the videos combined withaudio. The human expert may identify the culture of the individualswhose voice was played on the audio recordings, who were displayed onthe videos, or who were displayed on the videos with sound. Thepersonality type of each individual may be identified as a subgroup ofthe culture type of that individual. The human expert may annotate theidentified culture and personality type of each individual on therespective audio recording, video, or video with sound. While viewingthe video or videos with sound, and listening to the audio recordings,the human expert may identify meaningful indications of emotional statefrom biometric data, gestures, facial expressions, and vocal intonationsmade by the individuals. The human expert may annotate the meaningfulindications of emotional state derived from biometric data, gestures,facial expressions, and vocal intonations on the respective video, videowith sound, or audio recording. The human expert may interpret eachannotated meaningful indication of emotional state derived frombiometric data, gesture, facial expression, and vocal intonation and mayannotate the interpretation (e.g., meaning of) each annotated meaningfulindication of emotional state derived from biometric data, gesture,facial expression, and vocal intonation on the respective video, videowith sound, or audio recording. The biometric data may be continuouslygathered and may include the level of blood flowing through a person'scheeks (e.g., determine if an individual is showing signs of becomingflush). The expert may be looking for meaningful indications ofemotional state from the biometric data. For example, the expert may seean individual showing signs of becoming flush. Accordingly, the expertmay determine that the individual may be, for example, excited,embarrassed, upset, offended, or the like. For example, an expert mayview a video showing a first individual slowly and carefully bowing to asecond individual. The expert may annotate the video to indicate thatthe first individual may have a culture prevalent among inhabitants ofJapan and a passive personality. The expert may annotate the video toindicate that the bowing of the first individual is a bowing gesture andmay annotate the video to indicate the interpretation of the bowinggesture (e.g., a salutation). The expert may perform the above-mentionedsteps for each audio, video, and video with sound received (e.g.,training data), and for each person featured on the training data. Theexpert may also annotate facial expressions or gestures on training datathat may include, for example, still images.

Step S101 may include generating culture/personality signature filesusing the received training data. After annotating the videos, videoswith sound, still images, and audio recordings, signature files may becreated using the annotated videos, videos with sound, still images, andaudio recordings. The signature files may be used to identify aculture/personality subgroup of an individual in real-time audio andvideo, and expressions of the individual in real-time audio and video.Alternatively, classifiers may be trained to determine theculture/personality type and expressions of an individual.

A first set of signature files may be trained to determine the cultureand personality subgroup of an individual. A second set of signaturefiles may be trained to identify an individual's expressions andmeaningful indications of emotional state from biometric data. Theindividual's expressions may include facial expressions, gestures (e.g.,bowing), and vocal intonations. For example, the second set of signaturefiles may identify a bowing gesture on a video, or video with sound,illustrating a person bowing.

Step S102 may include developing a table with entries for all thedifferent culture/personality subgroups identified in the training dataof step S100. The table may include one entry for eachculture/personality subgroup identified using the training data. Theentry for each culture/personality subgroup may include the second setof signature files for detecting expressions and the correspondinginterpretation of each detected expression. One signature file maydetect one expression. Thus, the entry for each culture/personalitysubgroup may contain a plurality of signature files and a plurality ofinterpretations corresponding to the plurality of signature files.

Step S106 may be simultaneously performed with step S103. In step S106,a communication between two or more individuals may be monitored inreal-time using video, audio, or video and audio combined to classifythe culture/personality subgroup of at least one of the two or moreindividuals with reference to a first set of signature files. In stepS103, the communication between the two or more individuals may bemonitored in real-time, using video, audio, or audio and video combineddetect expressions of at least one of the two or more individuals usinga second set of signature files corresponding to the culture/personalitysubgroup of the at least of the two or more individuals.

For example, a first individual, among the two or more interactingindividuals, may say “howdy, it is nice to meet you” in a bolsteringvoice. The first set of signature files may identify “howdy, it is niceto meet you,” in a bolstering voice, as an expression used by residentsof the southwest United States, and may classify the first individual,for example, as having a culture prevalent among residents of thesouthwest United States and a forward-type personality.

In step S106, the classification of the culture/personality subgroup ofthe at least one of the two or more individuals may be communicated tostep S103. In step S103, the communication between the two or moreindividuals may be monitored with reference to the second set ofsignature files included in the entry of the table created in step S102that corresponds to the identified culture/personality subgroup of theat least one of the two or more individuals to identify expressions ofthe at least one of the two or more individuals. For example, the firstindividual, having a culture prevalent among residents of the southwestUnited States and a forward-type personality may extend a handshake to asecond individual. The handshake offer may be monitored with referenceto the second set of signature files corresponding to theculture/personality subgroup of the first individual.

In step S104, when an expression is identified for the at least one ofthe two or more individuals using the second set of signature files, theinterpretation of the gesture identified by the second set of signaturefiles may be retrieved using the table entry corresponding to theculture/personality subgroup of the at least one of the two or moreindividuals. The interpretation of “howdy, it is nice to meet you,” maybe that the first individual is greeting someone and is being courteous.

In step S105, the identified expression of the at least one of the twoor more individuals may be communicated to a user (e.g., the user may bealerted). The user may be the individual who was monitored, one of thetwo or more interacting individuals, or an individual not a party to theinteraction. For example, the first individual may be speaking to asecond individual in a loud voice. The first individual may be alertedthat he or she was speaking too loudly. In step S105, recommendationsmay be communicated to the user. For example, the first individual whowas speaking in a loud voice may receive a recommendation to lowerhis/her voice. The communication may be conveyed to the user inreal-time (e.g., as soon as the communication becomes available), onafter a delay.

When the expression identified in step S104 is interpreted to be anoffensive expression, the user may be alerted that the expression isoffensive and the culture/personality subgroup of the individual whomade the offensive gesture may be reclassified. For example, if thefirst individual made an offensive hand gesture, step S105 wouldcommunicate the offensive gesture and the interpretation of theoffensive gesture to step S103. Step S103 would communicate theoffensive gesture and the interpretation of the offensive gesture tostep S106. Step S106 would communicate the offensive gesture and theinterpretation of the offensive gesture to step S107. In step S107, thealready-classified culture/personality subgroup of the at least oneindividual may be reclassified using the offensive gesture and theinterpretation of the offensive gesture. For example, the firstindividual may be reclassified as an English speaker having a cultureprevalent among residents of southeastern United States, having anaggressive personality type.

Alternately, the at least one individual may be reclassified in stepS107, using the first set of signature files, based on the continuousmonitoring of the interaction between the two or more individuals. Forexample, the at least one individual may say something or act in a waythat may cause the method for interpreting interpersonal communicationto reclassify him or her into a different culture/personality subgroup.For example, the first individual may say “g′day mate” in a soft tone ofvoice. Based on the “g′day mate” in a soft tone of voice, the firstindividual may be reclassified as having the culture prevalent amonginhabitants of Australia and a passive personality. When an individual'sculture/personality subgroup is reclassified, the reclassifiedculture/personality type of that individual may be communicated to stepS103. Thus, the monitoring of the communication for identifyingexpressions may be performed using the second set of signature filesincluded in the table entry corresponding to the reclassifiedculture/personality subgroup of the at least one individual.

According to an exemplary embodiment of the present invention, a methodfor interpreting interpersonal communication may include generating adatabase of human cultures and personality subgroups.

Generating the database of human cultures and personalities may includereceiving a plurality of videos and audio material featuring individualsspeaking and/or acting. The individuals may exhibit their respectivelanguage, customs, habits, education level, skill in a particular areaof interest, facial expressions, gestures, vocal intonations, and thelike. A human expert may view the videos, still pictures, and videoswith sound or may listen to audio recordings of people speaking.

The human expert may profile the individuals acting in the videos or inthe audible data based on culture. For each culture, there may besubgroups based on the personality type of a particular individual. Eachculture/personality subgroup may include various expressions andinterpretations of the various expressions.

The expert may annotate videos, videos with sound, still pictures, oraudio recordings to include the culture/personality subgroup of eachindividual. The expert may annotate each expression (e.g., facialintonation, gesture, or vocal intonation) of each actor in the videos,audio recordings, videos with sound, or still pictures, and may annotatethe interpretation of each expression in the videos, audio recordings,videos with sound, or still pictures. The expert may also annotate anidentification of a language that each individual speaks.

Each expert-identified culture/personality subgroup may includeinterpretations of biometric data, expressions, gestures, vocalintonations, and the like of the individual grouped in the particularculture/personality subgroup.

Signature files may be created or classifiers may be trained todetermine the culture/personality type of an individual based on theannotated culture/personality subgroups and the annotated expressionsincluded in the database.

The database may include entries for each expert-identifiedculture/personality subgroup. Each entry on the database may correspondto one culture/personality subgroup. A first set of signature files maydetermine the culture/personality subgroup of an individual. A secondset of signature files may identify and interpret gestures, vocalintonations, and facial expressions of the individual using dataincluded in the database entry corresponding to the individual'sidentified culture/personality subgroup. The first and second set ofsignature files may be included in the database.

The method for interpreting interpersonal communication may use acognitive system to assist individuals of different cultures andpersonalities in interacting with each other. A cognitive system mayinclude a plurality of cognitive subsystems assigned to each interactingindividual. The cognitive system may include hardware such as a camera,a video camera, and a microphone to monitor individuals interacting witheach other. The monitored interactions may include each individual'slanguage, facial expression, gestures, vocal intonation, and the like. Acognitive subsystem of the cognitive system may interpret anindividual's monitored language, facial expression, gesture, vocalintonation, and the like, using the first and second set of signaturefiles and the generated database of human cultures and personalities andthe second set of signature files. The cognitive subsystem may recommenda course of action for each of the individuals to take (e.g., what tosay to another individual, how to act in front of the other individual,what gesture to display to the other individual, and the like) based onthe interpretation of the monitored interaction between the individualsusing the second set of signature files and the generated database ofhuman cultures and personalities. The recommendations may increase theproductivity of the interaction session between the two or moreindividuals. When individuals are classified into differentculture/personality subgroups, the different cognitive subsystemsassigned to the interacting individuals may communicate with each othervia a higher level cognitive system. The higher level cognitive systemis included in the cognitive system. The cognitive subsystems maycommunicate with the individuals they are assigned to, respectively.

The productivity of the interaction session may be increased, forexample, by assisting the parties to come to an agreement. Therecommended course of action may be conveyed to a recipient such as, forexample, one of the parties participating in the conversation,immediately after the recommended course of action becomes available orafter a delay.

The cognitive subsystem may also generate an alert to alert a user thatthe user's course of action may be offensive to another interactingparticipant.

After the user has been alerted or offered a recommended course ofaction, the method may loop to the beginning and may monitor theinteraction between the two or more individuals. Based on the othermonitored interaction, the culture/personality subgroup initiallyassigned to an individual may be changed to differentculture/personality subgroup. However, an individual may also bereassigned to the same cultural/personality subgroup that the individualwas previously assigned to. A first individual's course of action thatmay offend a second individual may also contribute to reassignment ofthe cultural/personality subgroup of the first individual.

FIG. 2 illustrates a flow chart of a method for interpretinginterpersonal communication, according to an exemplary embodiment of theinventive concept. Referring to FIG. 2, the method for interpretinginterpersonal communication may include performing step S201. Step S201may include monitoring an interaction between two or more individualsusing a set of monitoring devices. The set of monitoring devices mayinclude one or more cameras, video cameras, microphones, biometric datamonitors, and the like. Monitoring the interaction between the two ormore individuals in step S201 may include using the set of monitoringdevices to capture an image, a video, or a sound emitted by one of thetwo or more interacting individuals. The cameras or video cameras mayinclude biometric data monitors and may continuously detect anindividual's biometric data such as blood flow in an individual's faceor cheeks (e.g., the individual becomes flush).

The interaction between the two or more individuals may occur in-person,for example, where the two or more individuals meet face-to-face. Theinteraction between the two or more individuals may also occur via avideoconference, for example, where the two or more individuals may belocated in different areas of the globe and may use videoconferencingdevices such as display devices, cameras, and microphones to interactwith each other. Whether the interaction between the two or moreindividuals is conducted in-person or via a videoconference, the set ofmonitoring devices may be used to capture images, videos, or soundsemitted by each of the two or more interacting individuals. For example,the set of monitoring devices may be used to monitor two or moreindividuals having a conversation in the same room.

The one or more cameras may capture still images or videos containingsound. The one or more cameras may be focused on one of the two or moreindividuals and may be automatically moved to maintain focus on thatindividual. One camera may be used to capture still images or videos ofone of the two or more individuals. However, one camera may also be usedto capture still images or videos of all of the individuals to theinteraction. According to an exemplary embodiment of the inventiveconcept, a different camera may be used to capture still images orvideos of each individual participating in an interaction between two ormore individuals. For example, a first camera may be used to capturestill images or videos of a first individual, from among the two or moreindividuals, and a second camera may be used to capture still images orvideos of a second individual, from among the two or more individuals.

A video camera may capture videos containing sound and may be focused totrack one of the two or more individuals to the interaction. The videocamera may maintain focus (e.g., follow) the one of the two or moreindividuals when that individual moves. A different video camera may beconfigured to capture videos of each of the two or more individuals.According to an exemplary embodiment of the present invention, one videocamera may be used to capture videos of all the interactingparticipants.

The microphones may be used to capture the voice, vocal intonation, andother sounds made by one or more individuals. One microphone may be usedto capture sounds made by one individual, among the two or moreindividuals to the interaction. For example, a first microphone may beused to capture the voice of a first individual, a second microphone maybe used to capture the voice of a second individual, and the like.However, a single microphone may be used to capture the sounds made byall of the interacting individuals.

Monitoring the interaction in step S201 may include capturing an image,video, or sound emitted by one or more individuals participating in aninteraction between two or more individuals. The image, video, or soundsemitted by the one or more individual (e.g., a first person) may includea type of language spoken, words, vocal intonations, facial expressions,gestures made by an individual, and the like. The image, video, orsounds emitted by the first person may be captured using the set ofmonitoring devices. According to an exemplary embodiment of the presentinvention, monitoring the interaction in step S201 may includemonitoring all the individuals to an interaction. For example,monitoring the interaction in step S201 may include monitoring aninteraction between the first person and a second person. The firstperson may greet the second person by speaking words in the firstperson's native language. For example, the first person may say “g′daymate” to the second person. The second person may greet the first personby, for example, raising his/her left hand up.

According to an exemplary embodiment of the inventive concept, aninteraction between two or more individuals may be instantiated by avideoconference. For example, the two or more individuals may interactvia a teleconference, using the set of monitoring devices to see andhear each other. Thus, step S201 may include monitoring an interactionbetween two or more individuals on a videoconference.

Referring to FIG. 2, identifying a culture and personality type of atleast one of the two or more individuals in step S202 may be based onthe interaction that was monitored in step S201. For example, theinteraction that was monitored in step S201 included the first personspeaking words.

An individual's culture may include knowledge, beliefs, art, morals,customs, education, and any other attributes acquired by the individual.The individual may be a member of a society including a plurality ofindividuals who may share, to a degree, the same or substantially thesame knowledge, beliefs, art, morals, customs, education, and otherattributes. For example, the first person who spoke words to greet thesecond person in the above example may belong to a first culture.

An individual's personality may be a subset of that individual'sculture. Individuals having the same culture may have differentpersonalities. A person's personality type may include traits such asbehavior patterns, manner of expressing emotions, temper, gullibility,humility, and the like.

A database of cultural/personality information 203 may includeinformation specific to a plurality of culture types and a plurality ofpersonality types.

The database of cultural/personality information 203 may be generatedusing videos (e.g., the training data) displaying individuals speakingand acting. Each video displaying at least one individual speaking andacting may be annotated by a human expert. The annotations may includean identification of the language spoken by an individual displayed on avideo. Gestures, facial expressions, vocal intonations, and the like,made by each individual shown on a video, along with an interpretedmeaning of each facial expression, gesture, and vocal intonation may beannotated on the video. A facial expression may be, for example, a smilea frown, a twitch, and the like. The human expert may annotate a smileand may interpret the smile to mean (e.g., signify) a kind gesture or apositive reception of an idea. The human expert may annotate a frown tomean, for example, discord or a disagreement on the part of oneindividual participating in an interaction between two or moreindividuals. A gesture may be a wink, a thumbs-up hand gesture, ahandshake, a bow, a waving of the hand to signal departure, raising theleft hand to greet someone, and the like. A vocal intonation may be atone of voice having a constant pitch level (e.g., monotone pitch),which may signify a normal conversation, or changing pitch levels (e.g.,a rising pitch, a falling pitch, a pitch that falls then rises, a pitchthat rises then falls, and the like) to express emotion, surprise,sarcasm, and the like.

The human expert may identify the cultural/personality type of anindividual included in the training data and may interpret the gesturesof an individual included in the training data. The database ofcultural/personality information 203 may include a list of expressions,gestures, vocal intonations, and the like, signature files or trainedclassifiers to identify the expressions, gestures, and vocal intonationsof an individual, and the meaning of the expressions, gestures, andvocal intonations included in the training data. The signature files ortrained classifiers may detect the culture/personality type of anindividual in real-time audio, video, or video with audio, and maydetect and interpret gestures, expressions, and vocal intonations of theindividual having the detected culture/personality type usinginformation stored in the database of cultural/personality information203. A first set of signature files may detect the culture andpersonality type of an individual and a second set of signature filesmay detect gestures, vocal intonation, facial expressions, and the like,of an individual classified into a particular cultural/personalityprofile. The database of cultural/personality information 203 mayinclude information regarding each type of culture and each type ofpersonality that is included (e.g., indexed) in a database. For example,data describing a first culture, which may correspond to a cultureshared among inhabitants of northeastern Australia, may indicate that ahandshake symbolizes, for example, a greeting or an agreement, dependingupon the context in which it is offered. Data describing a secondculture, which may correspond to a culture shared among inhabitants ofJapan, may indicate that a handshake symbolizes, for example, an insult.An agreement, under the second culture type, may be symbolized by a bow.However, the data describing the first culture and the data describingthe second culture may overlap. For example, both the first culture andthe second culture may interpret a smile as a positive reception of anidea.

Identifying the culture and personality type of the first person in theabove example may include using the interaction that was monitored instep S201 with reference to the first set of signature files (e.g.,analyzing and scanning the greeting spoken by the first person inreal-time to identify a culture and a personality type of the firstperson with reference to a first set of signature files that may detectthe culture/personality type of a person). For example, identifying theculture of the first person (e.g., the first culture) may includeidentifying the first person as an English speaker, originating from thenortheastern portion of Australia, and having the knowledge, beliefs,art, morals, customs, and education prevalent among residents ofnortheastern Australia. The first person may be identified as, forexample, an entrepreneur, using the first set of signature files.Identifying the personality type of the first person may includeidentifying the first person as being extroverted. Identifying theculture and personality type of the second person may include using theinteraction monitored in step S201 (e.g., the second person raisinghis/her left hand up), with reference to the first set of signaturefiles, to determine that the second person has a culture prevalent amonginhabitants of Japan (e.g., a second culture) and that the second personhas a passive personality.

Retrieving the cultural/personality profile information in step S204 mayinclude retrieving cultural and personality profile information specificto the culture and personality type of the at least one of the two ormore individuals identified in step S202 using the database ofcultural/personality profile information 203. However, retrieving thecultural/personality profile information in step S204 may includeretrieving cultural and personality information specific to each of theparticipants to the interaction. Information specific to the identifiedcultural/personality profile of an individual may be retrieved using thesecond set of signature files and the corresponding interpretation ofthe gestures identified by the second set of signature files.

An interaction between two or more individuals may be monitored, inreal-time, using video, audio, or video with audio, with reference tothe second set of signature files or trained classifiers. Gestures,expressions, or vocal intonations of an individual may be identifiedusing the second set of signature files. For example, informationindicating that the first person has a culture prevalent among theinhabitants of northeastern Australia and that the first person has anextroverted personality type may be retrieved. The retrieved firstcultural and personality profile information may indicate that the firstperson may symbolize that he or she has reached an agreement by offeringa handshake. Retrieving first cultural/personality profile informationin step S204 may include retrieving information indicating that thesecond person has a culture prevalent among inhabitants of Japan, wherea handshake symbolizes an insult and a bow symbolizes an agreement, andthat the second person has a passive personality.

Monitoring the interaction in step S205 between two or more individualsusing the set of monitoring devices including the one or more cameras,video cameras, microphones, and the like, may include capturing animage, video, or sound emitted by one or more interacting individualsusing the set of monitoring devices. Monitoring the interaction in stepS205 may be similar to monitoring the interaction in step S201. In fact,it may be the very same step, although it need not be. For example,monitoring the interaction in step S205 may include monitoring the firstperson, who belongs to the first culture, extending a hand to the secondperson.

As described above, the monitored interaction in step S205 may beinstantiated via a videoconference. For example, as described above, thetwo or more individuals may interact via a teleconference using the setof monitoring devices to see and hear each other. The monitoredinteraction in step S205 between the two or more individuals may occuron the videoconference. However, since two individuals having ateleconference might not be able to shake hands, the monitoredinteraction in step S205 may include the first person substituting ahandshake gesture for another gesture that might not require physicalcontact between the two or more teleconferencing individuals to indicatean agreement between the parties.

Identifying a facial expression, gesture, or vocal intonation of the atleast one of the two or more individuals in step S206 may be based onthe interaction monitored in step S205 and may include analyzing (e.g.,scanning) the monitored interaction to identify a facial expression,gesture, or vocal intonation of one of the two or more individuals to aninteraction with reference to a second set of signature files. Thesecond set of signature files may detect expressions and gestures ofindividuals shown in videos, still images, and videos with sound. Thevideos may be live (e.g., real-time broadcasting of an individual actingand speaking) or previously recorded. The second set of signature filesmay detect vocal intonations, language spoken, and the like, in an audiostream. The audio stream may be live (e.g., real-time broadcasting of anindividual speaking) or previously recorded. The second set of signaturefiles may be applied to the real-time video, video with sound, or audioof an interacting person and may identify an expression of an individualwhen the individual exhibits a facial expression, gesture, or vocalintonation that the signature file may detect. Identifying the facialexpression, gesture, or vocal intonation in step S206 may includeidentifying a plurality of facial expressions, a plurality of gestures,and a plurality of vocal intonations of all the individualsparticipating in the interaction. A description of the facialexpressions, gestures, and vocal intonations is provided above and willbe omitted for brevity. Identifying the facial expression, gesture, orvocal intonation of the at least one of the two or more individuals instep S206 may include, for example, identifying the first person'sgesture of extending the hand to the second person.

Interpreting the identified facial expression, gesture, or vocalintonation of an individual in step S207 may include interpreting thefacial expression, gesture, or vocal intonation identified in step S206using the cultural/personality profile information retrieved in stepS204. When a signature file identifies a gesture, facial expression, orvocal intonation, the interpretation of the gesture, facial expression,or vocal intonation of the identified gesture is retrieved from thedatabase of cultural/personality information 203. The interpretation ofthe identified facial expression, gesture, or vocal intonation mayinclude advice on how to respond to the identified first facialexpression, gesture, or vocal intonation.

Communicating the interpretation of the identified facial expression,gesture, or vocal intonation to a user in step S208 may includecommunicating the interpretation of the identified facial expression,gesture, or vocal intonation of any of the two or more interactingindividuals to a user. The user may be one of the individuals, fromamong the two or more individuals interacting with each other (e.g., thefirst person), or a person not a party to the interaction between thetwo or more individuals (e.g., a third party who is not one of the twoor more interacting individuals).

For example, as described above, the first person extended his or herhand to the second person, attempting to shake hands with the secondperson. When the user is the second person, communicating theinterpretation of the identified first facial expression, gesture, orvocal intonation to the user may include communicating to the user thatthe first person seeks to shake hands with the user, and that thehandshake manifests a greeting.

Communicating the interpretation of the identified facial expression,gesture, or vocal intonation to the user in step S208 may includeadvising the user on how to respond to the identified first facialexpression, gesture, or vocal intonation. For example, the retrievedcultural/personality profile information specific to the culture andpersonality of the user (e.g., the second person) may be retrieved fromthe database of cultural/personality information 203 in step S204. Theretrieved information may indicate that the user (e.g., the secondperson) belongs to a culture (e.g., the second culture) where greetingsare manifested by bowing. Thus, advising the user on how to respond tothe identified first facial expression, gesture, or vocal intonation instep S208 may include communicating to the user a recommendation togreet the first person by bowing. Further, since the user may have apassive personality, advising the user on how to respond to theidentified first facial expression, gesture, or vocal intonation mayinclude recommending to the user to be more open to conversing with thefirst person to increase the productivity of the interaction between thefirst and second persons.

The retrieved cultural/personality profile information in step S204corresponding to the second person may include data indicating that thesecond person belongs to a culture where a handshake signifies an insultand that the first person attempted to shake hands with the secondperson. When the user and the first person are the same individual,communicating the interpretation of the identified first facialexpression, gesture, or vocal intonation (e.g., extending the hand in anattempt to shake hands with the second person) to the user may includecommunicating to the user (e.g., generating an alert) that offering ahandshake to the second person is potentially detrimental toconstructive conversation. Communicating the interpretation of theidentified facial expression, gesture, or vocal intonation in step S208,to the user (e.g., the first person), may include advising the user togreet the second person by bowing. The advice to bow may be based on thecultural/personality profile information corresponding to the secondindividual retrieved in step S204 (e.g., information that indicates thatthe second culture may customarily greet by bowing).

Determining whether the facial expression, gesture, or vocal intonationidentified in step S206 is potentially detrimental to constructiveconversation between the two or more individuals may include consideringthe culture and personality type of the two or more individuals who arenot the user. For example, the first culture of the first persondescribed above may be a culture shared among northeastern Australianswhere the handshake symbolizes a greeting or an accord between two ormore people. The first person may have an extroverted personality. Thus,the first person may be highly likely to offer a handshake to the secondperson in a business meeting, especially since the first and secondpersons belong to different cultures (e.g., the first person may beattempting to make a positive first impression on the second person).The second person, having the culture shared among inhabitants of Japan(e.g., the second culture), may perceive the handshake as an insult.Further, the second person may have a passive personality which maycause the second person to perceive the insult as being more severe thanan extroverted person belonging having a culture shared amonginhabitants of Japan. However, the first person did not intend to offendthe second person. Thus, determining whether the identified first facialexpression, gesture, or vocal intonation identified in step S206 ispotentially detrimental to constructive conversation between the two ormore individuals includes considering the culture and personality typeof the two or more individuals who are not the user.

The determination of whether the identified facial expression, gesture,or vocal intonation is potentially detrimental to constructiveconversation between the two or more individuals may include consideringwhether the facial expression, gesture, or vocal intonation identifiedin step S206 is detrimental to constructive conversation between the twoor more individuals. If the identified facial expression, gesture, orvocal intonation is determined to be detrimental to constructiveconversation between the two or more individuals, a degree of theseverity of the detriment that may be caused by the identified facialexpression, gesture, or vocal intonation may be communicated to theuser.

Communicating the interpretation of the identified facial expression,gesture, or vocal intonation to the user in step S208, whether the useris one of the two or more interacting individuals or a person who is notany of the two or more interacting individuals, may include sending theuser a text message, a voice message, a tactile message, an alert, andthe like, to a wired or wireless communication device that the user maypossess, view, hear, or feel. Each of the text message, the voicemessage, the tactile message, and the alert may convey the communicatedinterpretation of the identified first facial expression, gesture, orvocal intonation to the user, and may convey the advice to the user.

Since the user may be any of the two or more interacting individuals,all interacting individuals may view, hear, or feel alerts or messagesgenerated by the wired or wireless communication device. Thecommunication device may be a tablet computer, a laptop personalcomputer (PC), a desktop PC, a wireless phone, a walkie-talkie, anearpiece that may be worn by the user, a beeper, a smartwatch, and thelike. The smartwatch may display messages, audibly read receivedmessages, and may be programmed to notify the user by vibrating, thevibrations indicating that a message is received, that an advice isreceived, and the like. The earpiece may audibly deliver thecommunication of the interpretation of the identified first facialexpression, gesture, or vocal intonation to the user, including anyadvice, to the user's ear.

Communicating the interpretation of the identified facial expression,gesture, or vocal intonation to the user in step S208 may also includee-mailing the user with a summary of the meeting and recommendations onincreasing the productivity of a future meeting, uploading the summaryand the recommendations to a database (e.g., a data storage bankaccessible by the user, the two or more interacting individuals, orunrelated third persons, and uploading the summary and recommendationsto a public repository. The communication of the interpretation of theidentified facial expression, gesture, or vocal intonation in step S208may be substantially instantaneous (e.g., delivered as soon asinformation to be communicated is generated), or delayed (e.g., thecommunication may be delivered when the meeting is over).

When the two or more individuals interact via teleconference,communicating the interpretation of the identified facial expression,gesture, or vocal intonation to the user in step S208 may includesuperimposing the interpretation of the identified facial expression,gesture, or vocal intonation on the videoconference so that it may beobserved by the user (e.g., one of the two or more interactingindividual or a third party who is not interacting with the two or moreindividuals). For example, the first person may nod during theteleconference session. The nodding may be the gesture identified instep S206. Thus, communicating the interpretation of the identifiedfacial expression, gesture, or vocal intonation in step S208 may includesuperimposing text on the videoconference display viewed by the secondperson. The superimposed text may include the interpretation of the nod(e.g., the first's person's assent to a business model proposed by thesecond person). The superimposed text may be text appearing on the samescreen that displays the other parties to the interaction (e.g., thefirst person) or on a communication device described above.

After communicating the interpretation of the identified facialexpression, gesture, or vocal intonation to the user in step S208, themethod for interpreting interpersonal communication may automaticallyloop to step S201 to monitor the interaction between the two or moreindividuals.

Once looped to monitoring the interaction between the two or moreindividuals in step S201, the method for interpreting interpersonalcommunication between two or more individuals may include using the setof monitoring devices to capture an image, a video, or a sound emittedby one of the two or more individuals. Monitoring the interaction instep S201 after looping may be substantially similar to monitoring theinteraction in step S201 before looping. Monitoring the interaction instep S201, after looping, may include, for example, monitoring the firstperson speaking to the second person in English, with a smile and vocalintonation indicating excitement, the following words: “it is a pleasureto go over this business plan with you.”

Identifying a culture and personality type of the at least one of thetwo or more individuals, may include updating an identification of theculture and personality type of at least one of the two or moreindividuals based on the monitored interaction in step S201 afterlooping, using the first set of signature files that may detect theculture and personality of an individual. Updating an identification ofthe culture and personality type of at least one of the two or moreindividuals may include updating (e.g., changing) the identification andof all interacting individuals based on the monitored interaction.Updating the identification of the culture and personality type of atleast one of the two or more individuals based on the interactionmonitored in step S201 after looping may include, for example, changingthe identified culture and personality type of the first person, andclustering the first person as having a culture prevalent amongsoutheastern Americans (e.g., residents of Georgia). The personalitytype of the first person may be changed to average (e.g., neitherreserved nor extroverted). The changes to the first person's culture andpersonality type may be based on the signature files detecting the firstperson's words “it is a pleasure to go over this business plan withyou,” and detecting the smile of the first person and the excited toneof voice of the first person. Alternatively, updating an identificationof the culture and personality type of at least one of the two or moreindividuals may include maintaining (e.g., not changing) the identifiedculture and personality type of the at least one of the two or moreindividuals. For example, the identified culture and personality type ofthe first person, after looping, would remain unchanged (e.g., the firstperson would be assigned to culture shared among northeasternAustralians and would be assigned to an extroverted personality type).

In step S204, retrieving cultural/personality profile informationspecific to the updated identified culture and personality type of oneof the individuals having an interaction from the database ofcultural/personality profile information 203 may include retrieving acultural profile and a second personality profile for each of the two ormore interacting individuals specific to the updated culture andpersonality type of each individual. The information may be retrievedusing the entry of the database 203 pertaining to the updatedcultural/personality type of an individual. The retrieved informationmay include, for example, gestures, vocal intonations, and facialexpressions, interpretations of the gestures, vocal intonations, andfacial expressions, and signature files for detecting the gestures,vocal intonations, and facial expressions for the updatedcultural/personality type of an individual. For a given individual, fromamong the two or more interacting individuals, the retrieved culturalprofile information after looping may be different from the retrievedcultural/personality profile information prior to looping. As describedabove, the retrieved cultural/personality profile information prior tolooping may indicate that the first person has a culture prevalent amongthe inhabitants of northeastern Australia and that the first person hasan extroverted personality type. However, based on the updatedidentification of the cultural/personality type of the first personafter looping, in step S204, the cultural/personality profileinformation that may be retrieved for the first person from the databaseof cultural/personality information 203 may correspond to a culturalprofile shared among Georgians having an average personality. Forexample, the first person may be profiled as having the customs, habits,education level, and skill or training in a particular area of interest(e.g., training in attaining favorable business deals) of a Georgianbusiness-oriented person.

The interaction monitored between the two or more individuals in stepS205, after looping, may be monitored using the set of monitoringdevices including the camera, the video camera, or the microphone.Monitoring the interaction in step S205 may be similar to monitoring theinteraction in step S201. For example, monitoring the interaction instep S205 may include monitoring the second person nodding after abusiness offer was made to him or her (e.g., by the first person), usinga video camera.

A facial expression, gesture, or vocal intonation of the at least one ofthe two or more individuals, after looping, may be identified based onthe monitored interaction in real-time with reference to the signaturefiles corresponding to the updated cultural/personality profile of theat least one of the two or more individuals. Identifying the facialexpression, gesture, or vocal intonation of the at least one of the twoor more individuals in step S206 may include, for example, having asignature file that may be applied to real-time video and/or audio datadetect a gesture, facial expression, or vocal intonation of anindividual. For example, in step S206, the monitored nodding of thesecond person may be identified as a nod made by the second person usingthe signature files.

The facial expression, gesture, or vocal intonation identified in stepS206 may be interpreted in step S207. Interpreting the identified secondfacial expression, gesture, or vocal intonation of the at least one ofthe two or more individuals in step S207 may include retrieving theinterpretation of the gesture, vocal intonation, or facial expressionthat corresponds to the gesture, facial expression, or vocal intonationdetected by the second set of signature files. For example, interpretingthe identified facial expression, gesture, or vocal intonation of thesecond person, after looping, may include interpreting the nodding ofthe second person as an assent to the business deal by the second personusing the signature files associated with the updatedcultural/personality type of the second person. The second person mayhave assented to, for example, the business proposition made to him orher by the first person.

In step S208, the interpretation of the identified facial expression,gesture, or vocal intonation, after looping, may be communicated to auser. The user may be one of the individuals, from among the two or moreindividuals interacting with each other, or a different person not aparty to the interaction between the two or more individuals.Communicating the interpretation of the identified facial expression,gesture, or vocal intonation in step S208, after looping, may be similarto communicating the interpretation of the identified facial expression,gesture, or vocal intonation 107 after looping.

Communicating the interpretation of the identified facial expression,gesture, or vocal intonation to the user in step S208 may include, forexample, sending an audible message to the user via an earpiece attachedto the user's ear. The audible message may convey to the user, forexample, the first person, that the second person assents to the firstperson's business proposition. The audible message may further recommendto the first person to bow to the second user as a sign of respect andto conclude the business dealing. In step S208, the interpretation ofthe identified facial expression, gesture, or vocal intonation may becommunicated to the user in real-time or after a delay.

According to an exemplary embodiment of the inventive concept, a systemfor interpreting interpersonal communication may include a processor, aset of monitoring devices including a camera, a video camera, or amicrophone, and a non-transitory, tangible program storage medium,readable by the system for interpreting interpersonal communication,embodying a program of instructions executable by the processor, toperform method steps for interpreting interpersonal communication.

Two or more individuals that may be located in the same area mayinteract with each using the system for interpreting interpersonalcommunication. The two or more individuals may be negotiating businesstransactions or may be simply interacting with each other. The two ormore individuals may belong to different cultures, may have differentpersonalities with respect to each other, and may speak differentlanguages.

The two or more individuals may be communicating with each other in aroom. The room may contain cameras, display devices, microphones,wearable computers, handheld mobile devices, and the like, connected tothe system for interpreting interpersonal communication.

The system's cameras and microphones may be used to monitor aninteraction between the two individuals. A culture and personality typeof at least one of the two or more individuals may be determined usingthe monitored interaction.

The interaction between the two or more individuals may continue to bemonitored by the cameras and microphones and a facial expression,gesture, or vocal intonation of at least one of the two interactingindividuals, may be identified and interpreted by the system forinterpreting interpersonal communication. The interpretation of thefacial expressions, gesture, or vocal intonation of the individual maybe communicated to the user via a display device, a wearable computer,or a handheld mobile device connected to the system for interpretinginterpersonal communication.

FIG. 3 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept.

Referring to FIG. 3, the system for interpreting interpersonalcommunication (e.g., the system) may include a camera 310 forcontinuously monitoring the interaction between two or more individuals.For example, the camera 310 may be configured to continuously monitor afirst individual 301 and a second individual 302. The camera 310 mayobtain still images and/or video with sound of the first and secondindividuals 301 and 302. When more than two individuals interact witheach other, the camera 310 may obtain still images and/or video withsound of all the interacting individuals.

The microphone 320 may be connected to the system and may be configuredto monitor the interaction between the two or more individuals. Forexample, the microphone 320 may capture sounds emitted by all theinteracting individuals. According to an exemplary embodiment of thepresent invention, the microphone 320 may capture sounds made by thefirst and second individuals 301 and 302.

The camera 310 may be pointed toward a specific individual among the twoor more interacting individuals. The camera 310 may be configured toautomatically move to maintain focus on a specific individual. Forexample, the camera 310 may be configured to automatically move tomaintain focus on the first individual's 301 face even when the firstindividual 301 moves or rests.

The system may identify a culture and personality type of at least oneof the two or more interacting individuals by processing an image orvideo captured during the continuously monitored interaction. Afterprocessing the captured image or video to identify a culture andpersonality type of at least one of the two or more individuals, thesystem may retrieve cultural/personality profile information specific tothe identified culture and personality type of the at least one of thetwo or more individuals. For example, the system may determine that thefirst individual 301 may have a culture prevalent among inhabitants ofthe Bordeaux region of France, and a passive personality. The system mayretrieve cultural/personality profile information specific to theculture and personality of the first individual 301 from a database ofcultural/personality information. The database of cultural/personalityinformation may be generated similarly to the method for generating thedatabase of cultural personality information 203 described above. Thesystem may identify the culture of the second individual 302 to be, forexample, a culture prevalent among inhabitants of Japan. The personalitytype of the second individual 302 may be, for example, extroverted.

During the continuous monitoring of the two or more individuals, thesystem may identify a facial expression, gesture, or vocal intonation ofat least one of the two or more individuals. For example, the system maymonitor the first individual 301 offer a handshake to the secondindividual 302. The system may identify the offered gesture as ahandshake gesture offered by the first individual 301. The system mayinterpret the handshake, when offered by the first individual 301, tosignify that the first individual 301 is manifesting an agreement withthe second individual 302 in a respectful manner.

The system may display the meaning of the handshake in the displaydevice 330, using text, for either the first individual 301 or thesecond individual 302 to read, or for both the first and secondindividuals 301 and 302 to read in their respective languages.

The interpretation of the identified facial expression, gesture, orvocal intonation may be communicated to a user. The user may be any ofthe interacting individuals or an individual not a party to theinteraction between the two or more individuals. The user may wear awearable computer or a handheld mobile device.

When the user is the first individual 301, who, for example, offered ahandshake to the second individual 302, the system may generate an alertto inform the first individual 301 that a handshake is perceived as anoffensive gesture by the first individual 302. The alert may beprocessed by the system and may be communicated to the first individual301 via a handheld mobile device 340 that the first individual 301 maybe holding. The handheld mobile device 340 may be a mobile phone, awireless phone, a tablet computer, a smartwatch, and the like. Thehandheld mobile device 340 may contain software for receiving alerts andcommunications from the system and for transmitting those alerts to thefirst individual 301 via a tactile message (e.g., a vibration indicatinga received alert or other communication such as a text message or anaudible message), a text message, or an audible message (e.g., anearpiece connected to the handheld mobile device 340 that may audiblyconvey a message to the first individual's 301 ear).

The handheld mobile device 340 may alert the first individual 301 that ahandshake is potentially detrimental to a successful interaction withthe second individual 302 and may suggest to the first individual 301 tobow to the second individual 302 to increase the probability of asuccessful interaction with the second individual 302.

The second individual 302 may possess a wearable computer 350. Thewearable computer 350 may be a computer-driven device that is worn onthe person or clothing of the second individual. The wearable computer350 may run software that may receive alerts and other communicationssuch as suggestions, hints, and tips from the system for interpretinginterpersonal communication and convey the alerts and communications tothe second individual 302. The wearable computer 350 may send the secondindividual 302 a tactile message (e.g., a vibration indicating areceived alert or other communication such as a text message or anaudible message), a text message, or an audible message (e.g., anearpiece connected to the wearable computer 350 that may audibly conveya message to the second individual 302). The text message or audiblemessage that the wearable computer 350 may convey to the secondindividual 302 may include, for example, text describing the handshakeas an amicable gesture that indicates the first individual's 301agreement with the second individual 302. The wearable computer 350 mayvibrate when receiving an alert (e.g., that the first individual 301does not intend to offend the second individual 302 by offering ahandshake), or when receiving a recommendation such as, for example,encouraging the second individual 302 to bow as a sign of agreement.

The system for interpreting interpersonal communication may continuouslymonitor the interaction between the two or more individuals. During thecontinuous interaction, the identified culture and personality type ofthe at least one of the two or more individuals may be changed. Forexample, depending on the behavior exhibited by the first individual301, and the terminology used by the first individual 301, the cultureand personality type of the first individual 301 may be changed to adifferent culture and personality type. For example, the firstindividual 301 may be re-classified as a French-speaking Canadian withan extroverted personality.

The continuous monitoring of the two or more individuals may lead toidentifying a plurality of facial expressions, gestures, and vocalintonations of the interacting individuals. The system may communicatethe interpretations of the identified plurality of facial expressions,gestures, and vocal intonations to the user via the display device 330,the handheld mobile device 340, and/or the wearable computer 350.

When an alert and/or message for the user (e.g., the first and secondindividuals 301 and 302) is available, the delivery or the alerts and/ormessages to the user may be instantaneous or delayed. When the deliveryis instantaneous, it may be sent to the display device 330, the handheldmobile device 340, and/or the wearable computer 350 substantiallyinstantaneously. When the delivery is delayed, it may be sent to theuser via email, when the meeting is over, or it may be uploaded to adatabase or a public repository.

According to an exemplary embodiment of the present invention, a systemfor interpreting interpersonal communications may include two or moreterminals, each terminal including monitoring devices for monitoring anindividual located in the respective terminal.

Each terminal may include a camera and a microphone. The camera in eachterminal may display live imagery of the individuals located in theother terminals. For example, a first person located in a first terminalmay view a live image of a second person located in a second terminal.The live image of the second person may be captured by the cameraincluded in the second terminal.

A computer system may be connected to the displays, video cameras, andspeakers of the two or more terminals. The computer system may include aprocessor for processing images, video footage, and sounds made by theindividuals in the terminals. The computer system may process monitoredimages and sounds and may assign each individual located in eachterminal to a culture and personality type, respectively. The computersystem may include a database of cultural/personality information whichmay be used to retrieve specific cultural and personality informationfor the individuals assigned to the respective culture and personalitytypes. The computer system, while monitoring the interaction between thetwo or more individuals in the different terminals, may identify facialexpressions, gestures, and vocal intonations of the individuals and maycommunicate interpretations of the identified facial expressions,gestures, and vocal intonations to a user. The user may be any of theindividuals located in the plurality of terminals or a party notassociated with the interaction between the individuals in theterminals. The computer system may communicate interpretations of theidentified facial expressions, gestures, or vocal intonation to the useras soon as the interpretations of the identified facial expressions,gestures, or vocal intonation are available, or after a delay.

The computer system may be disposed in one of the terminals or may bedisposed in another location away from the terminals. When the computersystem is not disposed in one of the terminals, the two or moreterminals may communicate with the computer system via the Internet(e.g., via a cloud-based system).

During the continuous interaction of the individuals in their respectiveterminals, the computer system may re-assign (e.g., change) the cultureand personality type of at least one of the two or more individuals.

FIG. 4 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept.

Referring to FIG. 4, the system for interpreting interpersonalcommunication may include at least two terminals. At least oneindividual may be located in each terminal. For example, a firstindividual 401 may be located in terminal 1. A second individual 402 maybe located in terminal 2.

Terminal 1 may include a first display device 410, a first camera 420,and a first speaker 430. Terminal 2 may include a second display device450, a second camera 460, a second speaker 470, and a computer 480.

The first and second individuals 401 and 402 may be teleconferencingwith each other. For example, the first display 410 may display livevideo captured by the second camera 460. The second camera 460 may beconfigured to maintain focus on the second individual 402 and may beconfigured to automatically move to maintain focus on the secondindividual 402 when the second individual 402 moves. The live video maydisplay the second individual 402 interacting with the first individual401 via the videoconference. The first speaker 430 may emit live soundscaptured by a microphone disposed in terminal 2. The microphone locatedin terminal 2 may be embedded in the second camera 450 or may bedisposed on an inner surface of terminal 2 (e.g., where it may capturesounds made by the second individual 402).

The second display 450 may display live video captured by the firstcamera 420. The first camera 420 may be configured to maintain focus onthe first individual 401 and may be configured to automatically move tomaintain focus on the first individual 401 when the first individual 401moves. The second speaker 470 may emit sounds, live, captured by themicrophone disposed in terminal 1.

The first and second individuals 401 and 402 may teleconference witheach other by seeing live videos of each other and hearing each othervia the cameras, display devices, speakers, and microphones disposed intheir respective terminals.

The computer 480 may be a mainframe computer, a server, a workstationcomputer, a desktop PC, or a laptop PC. The computer 480 may beconfigured to receive still images, videos and sounds made by at leastone of the two or more interacting individuals located in the pluralityof terminals. For example, the computer 480 may be configured to receivestill images or video captured by the first camera 420. The computer480, for example, may be configured to receive sounds captured by themicrophone disposed in terminal 1.

According to an exemplary embodiment of the inventive concept, thecomputer 480 may be configured to continuously monitor the firstindividual 401 located in terminal 1 using images and video captured bythe first camera 420 and sounds captured by the microphone disposed interminal 1. The first camera 420 may be configured to automatically moveto maintain focus on the first individual 401.

The computer 480 may include a processor to process images, videos, andsounds, (e.g., images containing faces of individuals and sounds made byindividuals). A database of cultural/personality information may bestored in the computer 480. The database of cultural/personalityinformation stored in the computer 480 may be similar to the database ofcultural/personality information 203 described above. Alternately, thedatabase of cultural personality information might not be stored in thecomputer 480 but may be accessible to the computer 480.

The computer 480 may process images, videos, and sounds made by at leastone person located in at least one terminal to identify a culture andpersonality type of the at least one person located in the at least oneterminal. For example, during the interaction between the first andsecond individuals 401 and 402, the computer 480 may monitor theinteraction between the first and second individuals 401 and 402 and mayidentify a culture and personality type of the first individual 401 byprocessing the monitored images, videos, and sounds made by the firstindividual 401.

The computer 480 may assign the at least one of the two or moreinteracting individuals to a culture and personality type. Informationregarding the culture and personality type assigned to the at least oneof the two or more individuals may be retrieved from the database ofcultural/personality information. For example, the first individual 401may be assigned to a culture prevalent among inhabitants of southernIndia and may be assigned to an extroverted personality type. The secondindividual 402, for example, may be assigned to a culture prevalentamong residents of Myanmar and may be assigned to an extrovertedpersonality type.

Based on the continuous monitoring of the teleconference, the computer480 may identify a facial expression, gesture, or vocal intonation of atleast one of the two or more interacting individuals. The computer 480may interpret the identified facial expression, gesture, or vocalintonation of the at least one of the two or more individuals and maycommunicate the interpretation of the identified facial expression,gesture, or vocal intonation to a user. The user may be any of theindividuals located in the terminals or an individual not a party to theinteraction. The communication may be superimposed in one of the displaydevices located in the terminals.

For example, the first individual 401 in terminal 1 may exhibit athumbs-up hand gesture to the second individual in terminal 2 during theteleconference. The computer 480 may identify the thumbs-up gesture as asign of agreement on the part of the first individual 401. However, thecomputer 480 may also interpret the thumbs-up gesture as a gesture thatmay offend the second individual 402 having the culture shared amongresidents of Myanmar using the cultural/personality informationcorresponding to the second individual 402. The computer 480 may displaythe meaning of the thumbs-up gesture on the second display device 450,in text displayed on a portion of the second display device 450 thatdisplays the first individual 401. The system may communicate to thesecond individual 402 that the meaning of the thumbs-up gestureexhibited by the first individual 401 may be a sign of agreement betweenthe two parties, and that the first individual 401 did not intend tooffend the second individual 402.

The computer 480 may also audibly communicate the interpretation of theidentified facial expressions, gestures, or vocal intonations to theindividuals in terminals using the speakers disposed in each terminal.

The computer 480 may be disposed in one of the terminals, for example,in terminal 2, and may be connected to the second display device 450,the second camera 460, and the second speaker 470 via a wired orwireless connection. When the computer 480 is disposed in one of theterminals, the computer 480 may be configured to monitor images, video,and sound captured by the devices disposed in the other terminals viathe Internet. For example, when the computer 480 is disposed in terminal2, it may be configured to receive images, video, and sound captured bythe first camera 420 and the microphone disposed in terminal 1 using theInternet.

Alternatively, the system for interpreting interpersonal communicationmay be a cloud-based system. In the cloud-based system, there may be twoor more terminals as described above for videoconferencing. In thecloud-based system, the computer 480 may be stored away from theterminals and may be connected to the terminals using the Internet. Thecomputer 480 may process images and sounds captured from the terminalsand may communicate with the terminals using the Internet. For example,both terminal 1 and terminal 2 may have local computers that may enablea teleconference between the first and second individuals 401 and 402but the system for interpreting interpersonal communication may includeusing the computer 480 to monitor the interaction between the two ormore individuals (e.g., the first and second individuals 401 and 402),to process the images, video, and sound to identify, interpret, andcommunicate the interpretation of identified facial expressions,gestures, or vocal intonations to an individual. Images, video, andsound may be uploaded from each terminal to the cloud-based system.After processing the uploaded data, the cloud-based system may assignthe individuals into cultural/personality types and may communicate withthe terminals by transferring (e.g., having local computers in disposedin the terminals download) data which include communication of theinterpretations of identified facial expressions, gestures, or vocalintonations that the individuals located in the terminals exhibited.

The system for interpreting interpersonal communication may re-assign anindividual into a different culture and personality profile based on thecontinuous monitoring of the individual's acts, gestures, vocalintonations, and facial expressions.

The communications to the user or the interacting individuals may beinstantaneous or delayed. The communications to the user may further beuploaded into an external database or in a public repository.

According to an exemplary embodiment of the inventive concept, a systemfor interpreting interpersonal communication may include a processor, aset of monitoring devices, a computer connected to the set of monitoringdevices via a cloud-based connection, and a database. The set ofmonitoring devices may include a handheld mobile device having aprocessor, a camera, a microphone, a speaker, and a display fordisplaying messages and camera images. The set of monitoring devices mayinclude a head-mounted device (e.g., glasses) including a processor, acamera, a microphone, and an earpiece (e.g., speaker inserted in thewearer's ear), and a display for displaying messages and camera images.The display of the head-mounted device may be disposed on a lenspositioned in front of a wearer's eye and supported by the frame of thehead-mounted device.

The system for interpreting interpersonal communication may continuouslymonitor at least one of two or more interacting individuals using theset of monitoring devices. The system may interpret inter-culturalcommunication by monitoring at least one of the two or more interactingindividuals.

The system for interpreting inter-cultural communication may processimages and sounds of at least one of the two or more interactingindividuals using the processors in the monitoring devices or using theprocessor included in the cloud-based system. The processing of imagesof at least one of the two or more individuals and the processing ofsounds made by the at least one of the two or more individuals may beperformed in the handheld mobile device or in the head-mounted device.Alternately, the processing of the sound and images of the at least oneof the two or more individuals may be performed in the cloud-basedcomputer.

FIG. 5 illustrates a schematic diagram illustrating a system forinterpreting interpersonal communication, according to an exemplaryembodiment of the inventive concept.

Referring to FIG. 5, the system for interpreting interpersonalcommunication may include a handheld mobile device 503. The handheldmobile device 503 may be held by a first individual 501. The handheldmobile device 503 may include a processor, a video camera, a microphone,a speaker, and a display.

The camera of the handheld mobile device 503 may be directed to a secondindividual 502 that may be interacting with the first individual 501.The handheld mobile device 503 may be configured to continuously captureimagery (e.g., video) and sounds made by the second individual 502.

The system for interpreting interpersonal communication may assign thesecond individual 502 into a cultural and personality profile. Thecultural and personality profile assigned to the second individual 502may contain information specific to culture assigned to the secondindividual 502. The information specific to the culture assigned to thesecond individual 502 may be used by the system for interpretinginterpersonal communication to increase the productivity of thecommunication between the first and second individuals 501 and 502. Thespeaker of the handheld mobile device 503 may audibly translate thewords spoken by the second individual 502 in a first language, to wordsin a second language that the first individual 501 may understand. Thescreen of the handheld mobile device 503 may display imagery of thesecond individual 502 and may also display the interpreted facialexpressions, gestures, and vocal intonations made by the secondindividual 502 via text.

The head-mounted device 504 may include a frame with lenses mounted onthe head of the first individual 501. The head-mounted device 504 mayinclude a processor, a microphone, and a camera. The head-mounted device504 may further include a display disposed on a lens and positioned infront of an eye of the wearer (e.g., in front of the first individual's501 eye), and an earpiece inserted in an ear of the wearer. Thehead-mounted device 504 may capture videos and sounds made by the secondindividual 502. The display of the head-mounted device 504 may displaythe second individual 502 and may also display text messages ofinterpreted facial expressions, gestures, and vocal intonations made bythe second individual 502. The earpiece of the head-mounted device 504may translate the words spoken by the second individual 502 in a firstlanguage to a second language that the first individual 501 mayunderstand. The earpiece of the head-mounted device 504 may also audiblyconvey interpretations of facial expressions, gestures, and vocalintonations made by the second individual 502 to the second individual's501 ear.

The system for interpreting interpersonal communication may utilizeeither the handheld mobile device 503, or the cloud-based computer 505at one time.

The processing of the images and sound may occur in the head-mounteddevice 504, in the handheld mobile device 503, or in a cloud-basedcomputer 505.

The cloud-based computer 505 may be connected to the head-mounted device504 or to the handheld mobile device 503 via the Internet. For example,either the handheld mobile device 503, or the head-mounted device 504may be connected to the computer 505 via the Internet and upload videoimagery and sound captured be their respective cameras and microphonesto the computer 505. The computer 505 may process the received videoimagery and sound using a database 506 of cultural and personalitytypes. The computer 505, using the database 506 of cultural andpersonality types, may assign the individual 502 to a specific culturaland personality type, may re-assign the individual 502 to a differentcultural and personality type and may interpret gestures, vocalintonations, or facial expressions of the second individual 502 usingthe received video imagery and sound. The assignment and re-assignmentinto culture/personality type profiles and the interpretation of anindividual's gestures may be done by continuously monitoring theindividual's gestures, facial expressions or vocal intonations using thehandheld mobile device 503 or the head-mounted device 504. The computer505 may transmit the interpretation of the gestures, vocal intonations,or facial expressions of the second individual 502 to the handheldmobile device 503, or the head-mounted device 504. The handheld mobiledevice 503 may display the received transmittance of the interpretationof the gestures, vocal intonations, or facial expressions of the secondindividual 502 in its display, using text, or may audibly convey thereceived message to the first individual 501 via its speaker. Thehead-mounted device 504 may convey the received message to the firstindividual 501 via the head-mounted device's 504 display, using text, oraudibly, via the head mounted device's 504 earpiece.

The transmittance of the interpretations of the gestures, vocalintonations, or facial expressions of at least one of the two or moreinteracting individuals may be delayed and may be sent to the respectiveinteracting individuals via email or may be uploaded in databasesaccessible by the respective individuals, or may be uploaded to a publicencyclopedia such as Wikipedia.

FIG. 6 shows an example of a computer system which may implement amethod and system of the present disclosure. The system and method ofthe present disclosure may be implemented in the form of a softwareapplication running on a computer system, for example, a mainframe,personal computer (PC), handheld computer, server, etc. The softwareapplication may be stored on a recording media locally accessible by thecomputer system and accessible via a hard wired or wireless connectionto a network, for example, a local area network, or the Internet.

The computer system referred to generally as system 1000 may include,for example, a central processing unit (CPU) 1001, random access memory(RAM) 1004, a printer interface 1010, a display unit 1011, a local areanetwork (LAN) data transmission controller 1005, a LAN interface 1006, anetwork controller 1003, an internal bus 1002, and one or more inputdevices 1009, for example, a keyboard, mouse etc. As shown, the system1000 may be connected to a data storage device, for example, a harddisk, 1008 via a link 1007.

While the present invention has been particularly shown and describedwith reference to exemplary embodiments thereof, it will be understoodby those of ordinary skill in the art that various changes in form anddetail may be made therein without departing from the spirit and scopeof the present invention.

What is claimed is:
 1. A system for interpreting interpersonalcommunication, comprising: a processor; a set of monitoring devicesincluding a camera, a video camera, or a microphone; and anon-transitory, tangible program storage medium, readable by the systemfor interpreting interpersonal communication, embodying a program ofinstructions executable by the processor, to perform method steps forinterpreting interpersonal communication, the method comprising:monitoring a first interaction between two or more individuals using theset of monitoring devices including the camera, the video camera, or themicrophone; identifying a culture and personality type of at least oneof the two or more individuals based on the monitored first interaction;retrieving first cultural/personality profile information specific tothe identified culture and personality type from a database ofcultural/personality profile information; monitoring a secondinteraction between the two or more individuals using the set ofmonitoring devices including the camera, the video camera, or themicrophone; identifying a first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric dataof the at least one of the two or more individuals based on themonitored second interaction; interpreting the identified first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data using the first cultural/personality profileinformation; and communicating the interpretation of the identifiedfirst facial expression, gesture, vocal intonation, or indication ofemotional state derived from biometric data to a user.
 2. The system ofclaim 1, wherein the set of monitoring devices includes one or morecameras mounted and pointed toward the at least one of the two or moreindividuals, and wherein the one or more cameras are configured toautomatically move to maintain focus on the at least one of the two ormore individuals.
 3. The system of claim 2, further comprising awearable computer worn by the user, wherein the wearable computerreceives a message, and wherein the message includes the communicationof the interpretation of the identified first facial expression,gesture, vocal intonation, or indication of emotional state derived frombiometric data, via a textual message, an audible message, or a tactilemessage.
 4. The system of claim 1, further comprising a handheld mobiledevice, wherein communicating the interpretation of the identified firstfacial expression, gesture, vocal intonation, or indication of emotionalstate derived from biometric data to the user includes sending the usera text message that is displayed on the handheld mobile device.
 5. Asystem for video conferencing, comprising: a processor; two or moreterminals, each of the two or more terminals including a set ofmonitoring devices including a camera, a video camera, or a microphone;and a non-transitory, tangible program storage medium, readable by thesystem for interpreting interpersonal communication, embodying a programof instructions executable by the processor, to perform method steps forinterpreting interpersonal communication, the method comprising:monitoring a first interaction between two or more individuals, whereina first individual of the two or more individuals is located at a firstterminal of the two or more terminals, wherein a second individual ofthe two or more individuals is located at a second terminal of the twoor more terminals, and wherein monitoring the first interaction betweenthe two or more individuals includes using the set of monitoring devicesincluding the camera, the video camera, or the microphone included ineach of the first and second terminals to monitor the first and secondindividuals, identifying a culture and personality type of at least oneof the first and second individuals based on the monitored firstinteraction; retrieving first cultural/personality profile informationspecific to the identified culture and personality type from a databaseof cultural/personality profile information; monitoring a secondinteraction between the first and second individuals located at thefirst and second terminals using the set of monitoring devices includingthe including the camera, the video camera, or the microphone includedin each of the first and second terminals; identifying a first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data of the at least one of the first and secondindividuals based on the monitored second interaction; interpreting theidentified first facial expression, gesture, vocal intonation, orindication of emotional state derived from biometric data using thefirst cultural/personality profile information; and communicating theinterpretation of the identified first facial expression, gesture, vocalintonation, or indication of emotional state derived from biometric datato a user.
 6. The system of claim 5, wherein the system for videoconferencing is a cloud-based system, the cloud-based system includingthe two or more terminals communicating with the processor over theInternet.
 7. The system of claim 5, wherein each of the first and secondterminals, among the two or more terminals, includes a display deviceand a camera device, wherein the camera device included in the secondterminal is configured to automatically move to maintain focus on thesecond individual, wherein the display device included in the firstterminal is configured to display a camera image captured by the cameradevice included in the second terminal.
 8. The system of claim 7,wherein the user and the first individual are the same person, andwherein communicating the interpretation of the identified first facialexpression, gesture, vocal intonation, or indication of emotional statederived from biometric data to the user includes displaying a textualmessage on the display device included in the first terminal.